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(57) Abstract: 

PROBLEM TO BE SOLVED: To continuously reproduce 
a video and a sound without collapsing a decoding buffer 
in changing a plurality of multiplexing streams to be 
reproduced. 

SOLUTION: The size of access units for three kinds of 
video streams VS Q , VS 1 and VS w is detected individually 

by their respective access unit detectors 52a, 52b and 
52c, and the max. access unit size is detected by a max. 
value detector 53 1 and this is regarded as an access unit 
for a virtual video stream. Packetizing control information 
is sent by a scheduler 54 to packetizer 55a, 55b and 55c 
respectively based on information of this virtual video 
stream and other elementary streams to be multiplexed, 
and packetization is performed by multiplexing the 
elementary streams for each of the actual video streams 
VS n , VS., and VS 0 . 
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(57) mm] 

mm] mm<v&mfc* vv-^mv^xn^ 
3 mm<o v?*** h y - a v s 0 , v s 

VSz OT^t^y Y<D^ Sft-ttL-WtT^-fe;* 
Uftffl«5 3a, 5 3b, 5 3c TftfflU 

— Airftfe^^£ft-f"-<#^^^ y — ^ h y —a co if 

5 5a, 5 5b, 5 5c *ciSt) % HfgCD fcf hy^V 

So, vsi, vs, fe^fto^w >^ y — * hv—J^t 





1 

Iftfto^ ^^/Wt-g-^tr^ bx b y — ASrgff-rsx 

b^b V —J*coW&coT h<Z>^c#5SrJtlfc 
mm$l * *xfc*;*:«te:« L < * £ £ 5 KUMx b V ' — a 

±mmwc<D^^^j^/vm j ^<D\i^y b* b y — ^sw^t; 
xisr^-fe^^^^ h*sjiiEiE«^ b y-A 

<0T^-fe*^~3> bo*#$fcJ»fcftv^#te: N XfB^ 
-< ^J^Mt^<0\f-/ b* b y-w^t^^y b<0 

^t^^Lt, ^r^^^b&fflv^^r 

— A<£>^i3\ tr^-* by— A-ca>0, 

4>ft< £ fc*— t*^*-;* by— ASrSfTTfcXSi:, 

±mm&*bv—j±&u<D¥ ; Ta~*bv—j*b\^x, ± 
mum* bv—j*k±m&te< n^r^^ by- 

-hlE^^-y hftltli, ±IE7*a— ^(Ofltil&^JX^ 

1 !E*£>^ ^^/Ht-^ff^tSr ft. 
[i»#S3] 7*-f^/v«-g-<otr^ b y— ASrW-g- 

tt*^>r^*/WB#^^:y b;* b y — A«rSfr*-58: 

y—J*<Dfflfc<DT bO*#££rifctfcbT. 
is 

lE31«S*tfc*>c«^* U< ft £ <fc 5 ft{R«* b y — * 

^©^^^^ft-g-otr^ b y — ^srw-^t-rs 
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«#otr^ b y -Aor^t^^y b<£>;*:£££: 

4>ft< bhJr-"r^Jr* b y — A&^fg-rsgiff SB^F-S: 

10 ±1B*^~ — 7#gM*. XIBISffl^ b y — ASrteOtr 
b y ' — A i: Lt\ -bfBffiffl:* b y — A £ _h|E4>ft 

jiiBttft^T* ^ s^/Wff *oif ^ b y -A^fft 
sr^m-rsxg^ 

b.x hy-^tiOT^t^^ b<^;fc*iSSrJt« 
Lt, T^-fe^=^ b^>*^c«Sra«-rsxSi:, 
#7*=! — FftMtem^XT? v b <D±$ £ ^ _t 
IB»«* Jxfc**«J!i* U < ft 5 <fc 5 t-^Sl^ b y - A 
30 ^t^Xgt, 

_LfS«»(^^^ ^^/Kl^lf^ b* b y -Afc«F-^fb 
tSISl-^ _h1BT^-fe^^^^ b*s±lEfi«^ b y — A 
or^tw^j/ b©*#S^aWfcftV^i:#^, _h|E^ 
>f^^/Vfg-^COtr^ b* b V*-J*<DT?-te*^~y b<D 

3<%i$h±MfcM* by— Aorn^y b^*# 
^ b<t:-r^xmi:. 

_lib^^^ bib^tv/c^o^ hy-A^io^ 
b y -A^ugmxs^ irtts - h &%?mt-r 

40 ^/Wi^e^ifco 

[fll^S6] ilBWSIcof^^/uW^if j/ b^ b y 

— ±\<D%?** fcfcx tr^^ b y — J^xhv, 

^ft< 1 1)^--^^ b y-^£S:{rr£xa^ 

_hlB>ISffl^ b !)-A^t + f^ b y— J*t Lt, Jh 
fB^Kffi^ b y — A£_hfM>ft< irt^"-^^^ b y — 

50 -ASM — T^^r hy-A^s; b-ftfSn ^^r 
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##X?&5T^-tr;^~^ h(D±% £ kv*^ — b^Mk 

b'^M^^^XT ? ± y hO^^^i 

Xfa«»^^^^^^^^ b y -A4r«F-S-ft 

>f ^^«-^<OtTy b* b V —J±<DT ? -t *zL~y b<D 
±%£k±M®iM* bV—J±<DT?±x^~y b<D^ 

[ts*j®8] ±^mm<Dy*ji??Mn^<D\?y b^bv 

JilB{g^B^ h y — ASHE© br?* h V — A ^U, ± 
faffi** b y - A £ _LfE4>ft < £ ■b*-y*-C **bV — 

[0 0 0 1 1 

[0 0 0 2] 
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5MPEG (Moving PictureExperts Group) ^^XffJ 

[0 0 0 3] r^t, JtlBMPEGitt, I SO/ IE 
C JTC 1/SC29 (International Organization 
for Standardization / International Electrotechni 
calCommission, Joint Technical Coimnitee 1 / Sub Co 
10 mmitee 29 : H^WbMfll/SBRSaStiAK. 

««*AAl/WMS6 2 9) ©»WB»W«^#fl:0> 
ttWtt3»^l»*"C*> 9 . MPEG LTIS011172 
^ x MPEG2«flSl:UTIS01381836Sfc5o £*xk<0S 
(8«ipfc:*5V^ ^/v^^ -r ^ T &M1k<Dig. g -eisoill 
72-12HHS013818-13&S. Vt&<Dm S X?IS011172-2&ms 
013818-2*5. *fc*J*0>JB B "eiSOl 1172-3X1*18013818 

[0004] ^Mk^\^mm^@.o(ox\ 

20 Matt" St*— *i:v^fctt»<^~^**i«>T 

teux:) fa«-e2H-5 0 -tux, s^i-s*:*^ ^ 

»b**tfc5*-#&. ^m^^m^k^fcv*- 
[0 0 0 5] ^-^Sr^KflrTSi*^ »r*s>»«Dftfc 

n^k* b y "tthbon^t* b y 

[0 0 0 6] MPEG^tA (IS0/IEC13818-1 
30 V^i: IS0/IEC1 1172-1) X?^. ^(O^mt^bV—^ 

w~rz> 0 :rxrMWW5t^MPEG2 as 

0/IEC13818-1) ^n^7^hy-AMl^MPEGl 
^fA (IS0/IEC11172-1) ^ h y -AlCOV^X^^ 
dS, MPEG2^r^^h7^^h^hy^ 
(IS0/IEC13818-1) t)MPEG2^n^7^ h y — ^ 

[0 0 0 7] MPEG^rAXIt ffiffl^fty^^ — ^ 
40 O^^/V (STD : ^r^^-y^ h^n — ^) ^ 
^£:ft,X^X\ ^Ift^ris^ h y — "(7)ST 

D^i3V^TIU<. ^ftfc^y^roWaeSr^fcSft 
[0008] ::t:<7)std (^fA^^^hf 

<DW)fcZnW-fZ>o B6I4STD (v-^^A^ 

(A) RXf (B) fi, MPEG2^rAW/u^7A 
^ hy— ix<0«5g^T^MPEG2 h^^X^K— hy 

50 [0 0 0 9] STDttrt«l^f^>rA^Ps/^ 



5 

(S TC : System Time Clock) 1 6 fcPftfttSSW 
Ul/^c -?MPEG2^fWn^7^hy 

(SCR: System Clock Reference) irflHJ 
K£frtTV^£ 0 f f 3-/iiSTC^SCRl!i*L<ft5 

ux_rate field ^ h^tlX^^m^m^mTo 
[0 0 10] K*ffl*hfc^y^ttIt)fctO***tt 

>^?V-*bV - A, iriit>-h ff** b V 
7^*-*by-Aft^fc#l*<S*L. fraiwv^y^ 
b y — Aco^n— ^5/77, ^^trr^^y^r 

1 T43r'<v77 1 4t-A^^^5o 

[OOlll/^j/K^ttv H7fc:*i-J; 
7* =3—7^ ^^^-(A^^y/ (DTS : Decoding Tim 
e Stamp) . ^/f-^g^^?^ (PT 
S : Presentation Time Stamp) k P¥f:£ft,£B#fBit$ii£: 

>-^y— ^ hy— acdx^— K^te (r ^ir^^.^^ 

S?bTV^ 0 4#Ki, PTSit r^ir^^^^y b^^ 
S*b5HS*l&*LT*5SK DTSfi, r^-feJ^—i/b 
^M^tt^^J^LTV^o fcfciU DTS = PT 

s iftsrn^y h^ov^Tt^ pts©*w 

J^a— KS*lS 0 -r^-^^r 1 2^A^£*xfc 
7^t7«yHi s rOSTCWDTS^§ 

[0 0 12] rc9£?lcSTD (^fA^-yy 
=— *0 ^V^T^, l^i:S¥«FtfSTC16IC»n 

[0 0 13] ££: N ^fiffcKliSV^Tfi. ^©STD^ 

xi/^ >^ y — ^ h y ^©73-^5/77^^ 

— ^n— iBirt^T^^— ^n — U^V^<t STD^ 
<D'<*y? <D$kffe8$M SCR (^7fA^Py^y77l^ 

^ r 77§i^iit b 

flfttt*<. -LIE*— /^7p^T^7p-J:4D 
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**ftv^j:5^ ««0>try b* b y— A«r*»M-5 

*#WHA(i, ftfc#W7- 3 4 1 9 5 1^ 

[0 0 14] ^_hfi: s 0 7<Z> (A) OMPEG2^n^ 
h y— ^|doV^<Z>fftWT»«>5^ m7<D (B) 
MPEG2 h^>^/K— b y — -McoVvCfcBflS 
ft«3fiSr«Fo 0 m7<D (B) <Z> b 9 b* b y — 

j/ >m s ±|2IS0/IEC13818-1 (c*5V * *t S , 

[UJffl'M b (sync_byte) ^b^lel^^V^ (continui 
10 ty_counter) ^W4/^ b^^ttfcSo ^n^^y 
17 7- I^^Mfa- KWP*Stt. El 7 CO (A) OMPE 
GT'n^A.* b y— ^<Z?»*ira«"C*>5o 
[0 0 15] MPEGtTftlCfiGOP (Group of Pic 
tures i if VP <f-*r) i: 5«36i&3£> ?> * - 

tm^nGOPIrfn-K 
i-5©l!ifi(r<Z>GOP^JR"t-Str^^^Sr^Bi: bftv^ 

SfcOtrT*^ b y — A3&S*>5B5\ GOP^rgI»9#^^¥ 
4£ £ LtltO try**-* hy— ASr«3f9#x.sr^j6S-e 

20 

[0016] v^. ±ibo##. f fefefetrv**^ by 

— Ad$GOP"CBBCTV^*#"C^>'=«— KS*tTV^5 
21IW^^n^7^hy-^ot, -tjx-P 

b y— ^©«]9#*.Sr"srffii:i-5fc«>J2:, GOP 
<o9Lft&m— <o cursor y b *K:<&*ii,5 c h 3&s^v^ 

[00171 B8H ^<7)<£ 5 ftf^T^^O^n^ 

30 W©2o^n^7^ b y — ASraKtt^-BOOUix. 
TW^-t-5»&<0OT*r*bTV^S o H8 0> (a) 
J: b /n^^hy-APSO^^^PKOt 
/^7^PK1 K \£y*s>r^ hy^VOOGOPO^f- 
>?a^ /a^7^^hy^PS0^^^PK2t^ 
y^PKStct^VO^GOP 1 <07*~*&&m4k£ 
tiT^&o H18<E> (b) icmir&oK^ ^d^7 

A7hy^PSl^°7^PK0, PK1 S PK2I: 
lfrtVl^GOP0^7^^ 7^ci^7A7hy- 
APS l^^^PKSI^rtVlMOP 1 (D"f— 

40 ^^S^avO^ 

[00 18] Z*lt><DmS<D (a) , (b) o 

tzm* \z.&mik£titi2#:<D7'usf7j±x b y — 
i o ^mwct'p ^7 f y -A^7^*ft-eio 
nuGOP urtv—tt-fy? <ommk 

KJztK yujf^J** b y— ASr§J9#i^jj:*5V^T«J 

5 r i * "TIB 4 5 0 
50 [0 0 19]MifJ, 0 8 CO (c) ^-T^^t-x 
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tf^VO^GOPOco-r — ?#A*S}ifc8 % tfx^" 
Vl^)GOP1^7^W*^5OT, t^rtVO 

[0 0 2 0] 

[*B^*Lt5tt5IHI] WMKttfc: 
«ft0^a^5A^ h y— ^J&SiB«£*LTVvr. ^8t3£ 

[0 0 2 1] Ifil. SCR (-^^A^uy^ y 77 

fc:A;*> 2 o<o»»i~S^ ^ ^ Mov vc. 

K«S*tTV*5SCR) ^ (mJ<£> 
/<y ^ l^xy a - KS jxtv^ SCR) + ffi5'«5>^£> 

(ftO/^/ ^ fcxya- K*HTV^5 SCR) ^ (fl© 
✓^^KlJ^a— K$*tTV^5S CR) + (Bf^y^O 

^M)^APS0^y^PK0, PK1, PK2, P 
K3, •••^M^^I±it-^^^JifB^#^t)^o 

ojc^c^mfb^ti/rv^) N mS(D (c) ic^-TJ;? 
^ ^n^^hJ-APSOSr/^y^PKO, PK 

* hy— -fcfcSJPSa.T, ^o^A^hy-APSl 
co/^7^PK3^fflLt7^-^AAlJ: 5 kir 
Z>k, ^n^7A^ h y — AP S 0 ir^n^A;* h y 

—aps i (D^a^^-^n-etuai:^fTt3ttTv^<^ 

^y^Srtt*H*fcofci#^ STC (^TA^^fA 
^ny^) ^©/^y^lwya-KJJitV^SCR 

[0 0 2 21 2 . /^y7r 0>«fcl£ 
R#K«a*8i*Wi":^*^7*;* h y-A©isO«9#x.£r 
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[0 0 2 31 r<DSft2Sr. H9fc#»Uft*5>IMB1" 

£ 0 H9ra\ ^72-^777^(^7-^^) 
ififi^lSSrSttV^o r~-?09© (a) tts 09 
;ci£EI8© ( a ) l^fjl^i^n^^hy-AP 
SOSr/^^PKO, PK1, P K 2 , P K 3 , - kM 

\cKfym\*1tf$<os<y7 7<o&1&v*>Q. (r) tttTT* 

tV0MOP0^)7^, (-O iit f 7tV0(OGO 
10 Pl<07^-Cfc5o 09<D (b) #!lx.«EI8© 
(b) C/Tt <t 5 */n ^7 f y ^ A P S 1 
^PKO, PK1, PK2, PK3, —fcJHS»-R*Wb 
^^0/^^7 7^^-C*) , 9. (50 fStf-r^V 1 ©G 
OP0(Z)7-^, (^) tetfy^V lOGOP 1 C07— 
^"Cfc^o B9© ( a ) , (b) kh\^ -t*T,«t»tt 

^ ^^J: 5 ^lft^tifc7 fl n^7 h y 
Sr. 0!l;i«B8O (c) fc^TJ; 5 fc* R^a^n 
20 ^7^hJ-APS0^7^PKO, PKliiA/ 

APSl^y^PK3^^i:tSi:, /^y7 7l: 
fcT-r^V O^GOP 0 Of- * *S A A * t*7^- 
V 1 ©GOP 1 07- ^J&Stftil&SttSO-e, s<<y?T<0 
£rffm<OW»&, HI 9© (c) <0J;5fc:tt£ o --"C 
(;*-) ttif^^-v 0©GOP 0 07— (#) 
te:fc*7*-V 1 ©GOP 1 ©7 — ^TfeSo 
[0 0 2 41 tT^^-V 1 ©GOP 1 ©7 — ^£7^ — K 
tSiJI^ K*ttJLttSCR (W^Dy^9 7 
30 7^) (aoT, /^777^b^ltfttfj:DTS 

(t^^-^^^^^^a^^^^) iaot^ 9 . 7 
— ^©A**3J:W3i*iit#^>r 5 v-^* wo tmmK 

45©t, g|9© (c) ©<£ 5i:/^/7 7 0t- 7 
[0 0 2 5] ;«6WW\ J^Ufc*flNdfc*T*;S*bfc 

7^ hy— A*cov^rra^i-5^i:^<t9. um<o 

40 8StTR*ULfci:ti:, SCR^fi^«4t5 
rfcft<, *fc^^77r©^ftK*fi-e>ftv^J:5*^ , o 
^7A^hy — A«rdiy£U#5 <£ 5 *tV S^Wt#W 
Wife*5«tt;8f, 7*^ ^*yWt#fei£frifc, Ewe 
£ tu 6> ©;£ ifc^ei- J: 5 # bftfc^ ^ /u«-S-iWIB 

[0 0 2 6] 

50 h y-A^rgfiU ±IBtt«©7-f ^^WS#(7>fcr 
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fc5<fc5fcffiffl;* hy— ASfl^U ilBttft^^i^ 

[0 0 2 7] rftfefe. *§»Wtt, «^tV^;W& 
y h^ftSfc^a— KBSMfc **fcitiU 7*=*— KW«!J 

L<*SJ: 5*HEffl* hy— U 

^/vfS#©tr^ h y— ASr»-g-ft-t-5BR*!i x r^-fe 

■T^o Jiis^y hfti-^ua. r^-fe^^-^ 

s> h^ffi^^j^t^^ h y — A©r^t^=s^ ho 

^tV^'^s' hSrx^y MfcrTS^ &£VM*M# 

S>*t5* h y — A£r 1 o(7)ft^i LT»ft^ 
[0 0 2 9] Jrfrfi&l-tt. ttft^Vvb^SMPEGtrT* 

fflttfttfT**-* h y — ^Srfcfc^fcHfi-rstrT*^ h 

£ 3, ^ Si5 t^c# i: $ ttfcm 
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[0 0 3 0] tx 

h y— ASr**-T5^ai:. ^f^hy^i:LX^ 
10 <Offi[*fl<jfttf7*^ h y-^^rfcfc^t^-r^t:^^- 
* bV —J*<D& o Ki&V\ r-r h y — 

20 — b y-^l^^ftLXfeSt5^fco 0 
[0 0 3 1] 

[0032] Biii, *$m\cVhZ>7*4 ^f^m-^n-^ 

^ h y— AVSo—VS.»:iov^TOW^t;Sr#*.S 0 
[0 0 3 3] f^C->— yiJWLfetOTfcSs&^s a 
30 ^r^^»f^-^4^<J; 5*. _b|Bt^^ 

h y - ^ v So-v s 2 i-i(^f ftt^tf-^ 
m ttx 3ootrf^ h y — avso- vs2^ttx 

<D* b y — A^3ocOb*^^-^ h y — So-VS^ 
(PS 0 -PS 1 ) *«#ffl!l^*5V^TGOP {?>v—7Hr 

K77-^h75^ yt°-f77-^h7^^K7 

[0 0 3 41 4fc\ h77 P 7^-;VK77-^h77^ 
,S:U?y h^r— ^ h^^^ti. MPEG2K:J3^T 
50 ^S$ttTV^^^7^X?fc!9. Fi/^7-f-;VK77- 
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^ h75^J4>f^- *y -fc«rpfffi**1~£*§ 
r — ^h77^ii, m^\i^m^<Dy^^M,y—^ (2 

4 Sr>f ^ — If^Ht-SJ" (3 071/-^) 

[0 0 3 5] *llOWO>>7rAtlt m&Z>** 

[0 0 3 6] H1^*5V^T. r^"fe^^.= ^ h«lffl»5 

0, 5 1, 5 2 a- 5 2cf*. W y— JX b y — 

— ^ b y — ^o^c^n— ^ir^S'ftaSsftS— fro-^^A 

ir;*^~:y btftffl*5 Ofc36fe*U S4S*^97^ 

^ — AVSo, VSi, VSi d^jfL^frT^ir;*^— 
^ httfflSS 2a, 5 2b, 5 2c (c£l£>*x, -^(OflfeO^ b 

y-ATs^r^t^y h^m^5 l^asfetbSo 

*Lt, *7^t^s/Hft(i)«5 0, 5 1, 5 2 a 
— 52c WSV vf* tfh^ftKD^ UJlsjry—Xh)) — 

[0 0 3 7] i^WS5 3tts T^-fe^cx^^ blfe 
ttj§^5 2a, 5 2b, 5 2c 3SS^^f^ b y 

— AVSo, VSi, VSi <fc9#*#^*L£T^-fcr;^^ 
s> b SSrJfcftU 7^t^^=y KOi^tt^ 

[0 0 3 8] H2^r.©3S«<Z>« : 3 L Sr«-ro H2tlit» 
*>t> ^^Tv^J: 5 (^^ot f rt7i b y — a v So, v Si, 
VSt f-Mi-^T^ir^^^^ hSr«FMW^i*febT« 
V^TV^SdS, KBSKJ t n (n = 

1, 2, • - •) KM1rZ>T?-£xx-~y bO*#££r 

hfcura«ixTv^o mmfttevy*** v y-A 
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[0 0 3 9] ^a-7 5 4tt, £<DiKfflftftfcf-r;?J- 

* h y — apvs t-^coft&co^m^t-^t^i-'^ ^ y 
-^hy-A x tftbt*-f >r h 3 - a a s i , 

i?<D&ffih LT, *#ffl«A#*fc»«?7 - 3 4 19 
Tt> «fcV\> 

[0 0 4 0] ^-jry h-fKSS 5a, 5 5b, 5 5c i*. 

7 5 4»c:J;oTaASixfc»J»ft«Srfflv^ ^ 

tr^/^ — J 5 4^®^^^ b y-A (ffiaUTT 5 
20 >*-) PVSWtt^^^^yy^fToTV^^) 
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